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A class of nonlinear equations arising in transistor network analysis, 
as well as in other areas, has the form 

/.■(*,) + E *tA ~ bi = t - 1, 2, • • • , n (1) 

i-l 

or in matrix notation 

F(x) + Ax - b = 0, (2) 

where the nonlinearities /,(■) are continuously differentiable, strictly 
monotone increasing functions. Results by Willson 1 and Sandberg and 
Willson 2,3 on nonlinear networks have included broad conditions for the 
existence and uniqueness of a solution to equation (2). However, con- 
vergent computational algorithms for finding the solution have been 
given only for restricted subclasses of the class of equations that have 
unique solutions. 1,2,4,s These subclasses are characterized by a variety 
of restrictions on the matrix A and on the type of nonlinearities. In this 
brief we show that a single convergent algorithm exists for solving these 
equations under conditions virtually as broad as the known existence 
and uniqueness conditions. Peripherally, we obtain under these condi- 
tions a conceptually simple proof of the existence of a solution. 

The approach is to use the old technique (probably due to Cauchy) 
of converting a root-finding problem to a minimization problem. Let 

r(x) 4 F(x) + Ax - b, (3) 

and define the scalar valued "potential" function 

Q(x) A t t Bt (4) 

where B is an arbitrarily chosen symmetric positive definite matrix and 
T denotes the transpose. Then Q(x) is positive unless x is a solution 
of equation (2). Consequently, minimizing Q(x) is equivalent to solving 
equation (2) if in fact the nonlinear equation (2) has a solution. 
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Since Q(x) is continuous, we may regard it as a continuous surface and 
observe that if 

Q(x) — » * as ||x|| — > co (5) 

the so-called "level sets", 

}x :Q(x) <c\, 

are bounded for each number c > and there must exist a point x* where 
Q(x) attains a global minimum. Under what conditions will this mini- 
mum satisfy Q(x*) = so that x* is a solution of equation (2)? From 
equations (3) and (4) the gradient of Q is easily found to be 

VQ(x) = 2(D, + A t )Bt (6) 

where D x is the positive diagonal matrix whose ith diagonal element is 
j'i(xi) where the prime denotes differentiation. Since the gradient must 
be zero at a minimum, either (i) 

r(x*) = 0, 

or (it) 

det {Ac + A) - at x = x*. 

If A is in the class of matrices P characterized by the property 3 

det [D + A) 5* for all diagonal matrices D > 0, (7) 

it follows that condition (i) holds so that x* is a solution of equation (3) 
for A in P if condition (5) is satisfied. But Theorem 5 of Ref. 2 implies 
that condition (5) is satisfied if A is in P and the range of the non- 
linearities /,-(•) is the entire real line.* Uniqueness of the solution of 
equation (2) is very simply shown in Ref. 2. Reference 3 shows that the 
basic condition, A in P , is satisfied for large classes of transistor net- 
works. 

The minimum of a continuously differentiable function with bounded 
level sets can always be found by a gradient descent algorithm when the 
gradient has a unique root. 6 No assumption regarding convexity or the 
behavior of the Hessian matrix is necessary. Clearly, a sufficiently 
small change in x in the negative gradient direction will always decrease 
the potential Q(x) unless x is already at a minimum. A sequence of itera- 
tions of this type, that is, 



* Recently Sandberg" has shown that condition (5) holds without any require- 
ments on the range of the nonlinearities if A is nonsingular as well as in Po. 



OPTIMIZATION TECHNIQUES 3137 

X, + I = X k - 7* VQOO, (8) 

monotonically reduces the potential Q(x) and yields a bounded sequence 
of points x* because the level sets are bounded. Convergence of the 
algorithm (8) is assured if the step sizes can be made large enough so that 
the potential Q(x k ) approaches zero rather than a positive limit. This 
can be achieved by making y k depend on the size of the gradient in such 
a way that y k cannot approach zero unless the gradient is approaching 
zero. Goldstein 6 gives the following procedure for selecting y k . Define 
the normalized potential drop: 

, . Q(x) - Q[x - y Vfl(x)] n (i)) 

a continuous function of 7 which assumes all values between 1 and as y 
ranges between zero and some positive value. Then for any 8 with 



< 5 < * 



choose y k so that 



5 g g(x k , y k ) £ 1 - 8 (10) 

if g(x k , y k ) < 8; otherwise let y k - 1. Note that y k can be chosen by trial 
and error computation in each iteration. For small 5 few trials are neces- 
sary; but the resulting drop in potential in each iteration is smaller so 
that more iterations are needed. With this method of choosing 7* , con- 
vergence of the algorithm (S) is assured for any starting point x . 
In summary, using the optimization approach and a result of Ref. 2 
we have shown the existence of a solution to equation (2) and the 
availability of a convergent algorithm to find the solution under the 
following conditions. 

(I) the nonlinearities /,(•) are continuously differentiable, strictly 
monotone increasing, and map the whole real line onto itself, and 

(II) the matrix A is in the class P • 

The original existence conditions given in Ref. 2 do not include the 
"continuously differentiable" assumption but are otherwise identical to 
conditions I and II above. 
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